The Orbitofrontal Cortex and Ventral Tegmental Area Are Necessary for Learning from Unexpected Outcomes
نویسندگان
چکیده
Humans and other animals change their behavior in response to unexpected outcomes. The orbitofrontal cortex (OFC) is implicated in such adaptive responding, based on evidence from reversal tasks. Yet these tasks confound using information about expected outcomes with learning when those expectations are violated. OFC is critical for the former function; here we show it is also critical for the latter. In a Pavlovian overexpectation task, inactivation of OFC prevented learning driven by unexpected outcomes, even when performance was assessed later. We propose this reflects a critical contribution of outcome signaling by OFC to encoding of reward prediction errors elsewhere. In accord with this proposal, we report that signaling of reward predictions by OFC neurons was related to signaling of prediction errors by dopamine neurons in ventral tegmental area (VTA). Furthermore, bilateral inactivation of VTA or contralateral inactivation of VTA and OFC disrupted learning driven by unexpected outcomes.
منابع مشابه
Reward-based emotions: affective evaluation of outcomes and regret learning
1. The emotions related to experiencing rewards or punishers are not independent from the outcomes that have not occurred. Indeed, it is the counterfactual reasoning between the obtained and unobtained outcomes that determines the quality and intensity of the emotional response. 2. A key behavioral observation is that patients with lesions in the orbitofrontal cortex are unable to experience re...
متن کاملWhat is the role of orbitofrontal cortex in dopamine dependent reinforcement learning ? !
Orbitofrontal cortex (OFC) has been implicated in signalling reward expectancies, but its exact role , and how this differs from that the role of ventral striatum (VS), is an open question. One idea is that VS is the seat of value learning in model-free, dopamine-dependent reinforcement learning, while OFC represents values in dopamine-independent model-based learning. However, recent results [...
متن کاملOrbitofrontal Cortex as a Cognitive Map of Task Space
Orbitofrontal cortex (OFC) has long been known to play an important role in decision making. However, the exact nature of that role has remained elusive. Here, we propose a unifying theory of OFC function. We hypothesize that OFC provides an abstraction of currently available information in the form of a labeling of the current task state, which is used for reinforcement learning (RL) elsewhere...
متن کاملDopaminergic and non-dopaminergic value systems in conditioning and outcome-specific revaluation.
Animals are motivated to choose environmental options that can best satisfy current needs. To explain such choices, this paper introduces the MOTIVATOR (Matching Objects To Internal VAlues Triggers Option Revaluations) neural model. MOTIVATOR describes cognitive-emotional interactions between higher-order sensory cortices and an evaluative neuraxis composed of the hypothalamus, amygdala, and or...
متن کاملThe Effect of Intra-ventral Tegmental Area Injection of Ghrelin on Morphine-Induced Amnesia in Male Rats: An Experimental Study
Background and Objectives: Extensive evidence shows that morphine impairs cognitive functions. On the other hand, ghrelin is a gastrointestinal hormone that affects learning and memory process. The purpose of the current study was to evaluate the effect of intra-ventral tegmental area (VTA) injection of ghrelin on morphine-induced amnesia in male rats. Materials and Methods: In this experiment...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Neuron
دوره 62 شماره
صفحات -
تاریخ انتشار 2009